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Abstract 

We discuss the case of simultaneous mixing of gauge bosons and mixing of fermions in a model in- 
dependent way and for a variety of extra-fermion representations. In this context we analyze a class of 
lepton family violating processes, namely Z — > ef , Z — » /if, Z — > e/i, /i — > eee, r — » eee, r — > /i/i/i, r — > e/ip 
and t — > /iee in the presence of one extra neutral gauge boson, Z', with universal, non-universal or family 
' changing couplings. We derive bounds on the combined effect of Z-Z' mixing and ordinary-exotic lepton 

■^j- '. mixing. 
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! 1 Introduction 

\ Tree level family changing neutral current (FCNC) interactions arise in extended models from three possible 
sources: (i) the exchange of family changing neutral gauge boson, (ii) the mixing between exotic and ordinary 
fermions and (iii) the existence of neutral scalars in the Higgs sector with family violating couplings. However, 
if the standard neutral Z° boson mixes with a boson which has a coupling which is either family changing or 
nonuniversal, its coupling to the light (that is the ordinary) fermions becomes family changing even in the 
absence of mixing between exotic and ordinary fermions. 

In previous works an extensive research has been performed in the context of FCNC produced by the mixing 
of the standard neutral gauge boson whith one which do not couple universally to fermion generation [1], or by 
the mixing between exotic and ordinary fermions [2, 3]. In this communication we show how this phenomenon 
arises in the general case of simultaneous mixing of neutral gauge bosons and mixing of ordinary fermions 
with exotic ones. We do not consider in this article FCNC arising from the exchange of scalars, nor additional 
indirect effects such as the shifts induced by the mixing between the neutral gauge bosons in the values of 
the weak angle 8 W , the p parameter and the Fermi coupling constant Gf [4-6], since they are irrelevant for 
the present analysis. We apply the formalism in a model independent way to several lepton family violating 
processes in the e-^, \i-t and e-r sectors considering several possible exotic fermionic representations. We 
obtain in each case bounds for the mixing parameters including the possibility that the contribution of the 
neutral gauge boson mixing and that of the fermion mixing are of the same order. 

Wc describe in section 2 the formalism for dealing with FCNC which arise from simultaneous mixing 
of gauge bosons and mixing of fermions. This formalism is applied to the leptonic sector in section 3. In 
subsection 3.1 we describe how the mixing effects modify the diagonal couplings of the Z. In subsection 3.2 
we apply the formalism to the Z — > IJj, li — > Ijljlj and ij — > Ijlklk decays and obtain constraints for the 
mixing parameters. These bounds are refined in section 4 considering special types of representations for the 
additional fermions. 
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2 Mixing effects: the general formalism for simultaneous mixing of 
gauge bosons and mixing of fermions 

To discuss the mixing of the massive neutral gauge bosons of a general theory we first divide them into two 
classes, 

• The standard Z° gauge boson which is a linear combination of the SU(2)l®U(1)y neutral bosons and 
has universal family diagonal (UFD) couplings determined by the eigenvalues £3 and q of the clectroweak 
generators T3 and Q. 

• The extra Z° gauge bosons which can have either UFD or non universal family diagonal NUFD or FC 
couplings. The last two types of couplings arise when the Z° gauge bosons are associated with horizontal 
interactions. Since the case where Z° has UFD couplings has already been discussed in the literature 
[3, 4, 7], we will concentrate our attention on the cases of NUFD [1] and FC couplings. 

To discuss the general mixing of fermions, including additional ones, we follow Langacker and London [2] 
grouping all fermions of a given electric charge, q, and a given helicity, a = L, R, in a n a + m a vector column 
of n a ordinary (O) and m a exotic (E) gauge eigenstates t/>° = (tpo,tpE) a ■ The relation between the gauge 
eigenstates and the corresponding light (I) and heavy (h) mass eigenstates ip a = {ij>l,iph)J, is given by 

C = ^a, (1) 

where the unitary matrices U a have the block form 



(2) 




U a = 

and the submatrices A a and G a are not unitary but satisfy the following conditions 

' AtA + F+F A+E + F+G \ / 1 \ 



(u t u) a = 



EtA + G f F E+E + GtG 



1 



(3) 



The term (F^F) , second order in the small exotic-ordinary fermion mixing, induces FC transitions in the 
light-light sector. 

The neutral current term for the multiplct ip of a given electric charge, for the case when both types of 
mixings are present, is then 



• E 

a=L,R 



( z °\ 

z? 



V K J 



i> a r (U a D a U a , UlHX, • • • , U^U^ t/> a R 



a=L,R 



/ Z \ 

Zi 

V z « J 



(4a) 



(4b) 



where sg w and c# w are sin^w and cos6> w respectively, 9 W is the weak mixing angle, R is the (n + 1) x (n + 1) 
orthogonal matrix that diagonalizes the neutral boson mass matrix, D is the (n a + m a ) x (n a + m a ) matrix that 
expresses the coupling of the Z° gauge boson to matter fields, and similarly are the (n a + m a ) x (n a + m a ) 
matrices that express the coupling of the NUFD and FC gauge bosons to matter. The electromagnetic part 
of £ nc has not been displayed since its structure is not affected by the mixing effects. 
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In the simple case of only one extra neutral gauge boson, the R matrix is easily parametrizablc as 



, cos 9 — sin 6 , 
K _ I sine cos9 I (5j 



and the neutral current term is now, 



- ^a7"Ut(D„ cos6 + H a sine, H a cos 6- D a sine) U ^„ ( |, ) ■ ( 6 ) 



It should be obvious that the treatment of the general case, eqs. (4a) and (4b), is straightforward. From 
now on we restrict the discussion to the case of only one extra gauge boson just to simplify the notation. In 
eqs. (4a), (4b) and (6) the D a matrices are given by 

D a = (T 3 -Qsg w ) o . (7) 

They are diagonal by definition and in the case, which we assume for simplicity from now on, that the exotics 
of a given charge and helicity have a common eigenvalue of T3 a , they can be written as 

°- " ( ta0 "o° s2 ~ <« 

where t30a and t3E a are square matrices of dimension n a and m a respectively. They correspond to the ordinary 
and exotic part of the T3 a operator and they are proportional to the unit matrix through the eigenvalues t^oa 
and t^Ea of T3 a . This is the same situation for the qoa and qEa matrices in relation with the Q operator. 
Contrary to the D a matrices, the H ones are not diagonal in general but can however be written as 

-( H 0°H°J. 

where Ho and He represent the interactions of the Z° with the ordinary and exotics fermions respectively. 
The point is that there are no Heo nor Hoe terms in H (which would give rise to mediated transitions 
between exotic and ordinary fermions) as long as the horizontal group commutes with the Standard Model 
(SM) gauge group. 

In the basis where the fermions are mass eigenstates, the form of D and H is 



(UtDU) R = *3ER-Qsg w , (10a) 




U f DU) T = t 3Eh +[ t 3 OL-Qsl, (10b) 



and by using the unitarity conditions (3) we can rewrite the last equation as 

/ FtF -AtE \ 

(U f DU) L = ^ J feEL-i 3 oL) + T 3L -Qs2 w . (10c) 

From cq. (10a) one can see that for the light fermions, and in the absence of Z°-Z1 mixing, the coupling of 
the Z° to right handed FC and non-universal family diagonal neutral currents (NUFDNC) is possible only if 
i 3 ER 7^ 0. Furthermore, from eqs. (10a) and (10c) it's easy to sec that sequential fermions do not induce FC 
nor NUFD couplings for the standard Z° since their contribution to these currents is canceled out by that of 
the ordinary fermions. 
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On the other hand, no general statement can be made for the transformed H couplings: 

. i , / AtH A + FtH E F, AtH E + FtH E G \ / H„ H lh \ 

(U f HU) = = . (11) 

V EtH A + GtH E F, EtH E + GtH E G ; a \ \\\ h H hh J a 

From the last equation one can see that in the presence of neutral gauge boson mixing, O ^ 0, there will be 
in general FC couplings of the Z in the light sector, H« nondiagonal, even in the absence of mixing between 
exotic and ordinary fermions, F = and even if the coupling of Z° to the ordinary fermions, Hq, is diagonal 
but nonuniversal, since in general the mass and gauge eigenstates will not coincide in the light sector, 1. 

2.1 The general neutral current lagrangian term in the light sector 

From cqs. (10a), (10c) and (11) we obtain for the neutral-current lagrangian in the light-light sector the 
following expression: 

- E tla-fiKa, K'a)1>la( \ ) • (12) 



a=L.R x 7 M 



where 



K l = [(F t F) L (t 3 EL-i30L)+t 3 oL-Qse w ] cos9 + (H„) L sine, (13a) 

K R = [(F t F) R t 3 ER-Qs^ w ]cose + (H H ) R sine, (13b) 

K l = - [(F t F) L (i 3 EL-i30L)+t 3 oL-Qs^] sine + (H H ) L cose, (13c) 

K R = - [(F t F) R t 3ER -Qs^ w ]sine + (H„) R cose. (13d) 
From these eqs. it is easy to see that: 

- There are two contributions to the FC couplings of the light fermions to the Z, proportional to 
(F^F) a cose and (H/;) a sine respectively, which may be in principle of the same order; 

- In the limit of no mixing between exotics and ordinary fermions (F a = 0) and no mixing between the Z 
and the extra gauge boson (O = 0) the SM couplings are recovered; 

- In the absence of mixing with the exotic fermions, the FC couplings of the ordinary fermions (of a given 
helicity) to the Z may still survive through the term (Hjj) a sine, provided that the family of ordinary 
fermions of the given helicity transforms nontrivially under the horizontal generator Ho- 

Further details of these couplings depend on the model and on the processes under consideration and are 
the subject of the next sections. 

We may rewrite eqs. (13a) and (13b) as 

K L = (A L +t 30 L -Qse w ) cose + H L sine, (14a) 

K R = ( A R - Qs^ w ) cos e + S R sine, (14b) 

where 

A L = (F t F) L (t 3EL -t 30L ), (15a) 

A R - (FtF) R i 3ER , (15b) 

3a = (H«) a) (15c) 
together with 6, represent the physics beyond the SM. 
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2.1.1 Charged fermions 

Since for the light charged fermions, the dimension of and ipiR are the same (there is an equal number of 
left and right handed fermions), we can rewrite the general lagrangian (12) as 



_ £ nc = 



2se Co 



-^7 M (gv - gA7 5 , gv - gA7 5 ) V> 



Z' 



where 



gv 

gA 



Kl + Kr, 
Kl — Kr, 



(16) 



(17a) 
(17b) 



3 Applications to the leptonic sector 

3.1 Constraints from the lepton family diagonal processes Z 



The effects of mixing between ordinary and and exotic fermions on the diagonal process Z — > kk has been 
analyzed previously [2-4]. Likewise separate effect of mixing between the standard Z and a new one were 
discussed in Ref. [4,5]. When both effects are present, the branching ratio B(Z — > kk), in the Mz S> rai i 
approximation, is given by 



B(Z -» kk) 



1 G F Afg 

J- tot 



9v 



1 G F M, 



7T V 



A? 



ffA 



5"e 



s2j 2 + |Ag + sse + s2 w | 2 )+o(e 2 ). 



(18a) 



(18b) 



J- tot 

Since the agreement of the SM predictions with the experimental data for these processes is better than 0.1 % 
(the experimental value of T(Z — > 11) is 83.83 ± 0.27 [8] against the theoretical one equal to 83.97 ± 0.07), the 
quantities A™ + S™6 are bounded practically by the experimental uncertainty in the data [8], 



B, 



B(Z -» kk) 



B 
B 

B T 



/'/' 



= (3.366 ± 0.008) x 10- 2 
= (3.367 ± 0.013) x 10- 2 
= (3.360 ± 0.015) x 10- 2 . 



We may also write 



1 +s 2 

2 + s 0„ 



+ |Aii + sge + s 2 ^ 



cB 



where c 1 = (rTT^^f) = 0-2675 ± 0.0005 and from which we obtain, in a neighborhood of |A" 

A" + 31*01 < fewxlO" 3 . 



S"6 



and with s 2 w = 0.2237 ± 0.0010, the bounds 



(19) 

(20) 
I = 

(21) 



3.2 Constraints from lepton family violating processes 
3.2.1 Constraints from Z — > klj 

With the approximation Mz S> rn\ i , mi j , and taking into account that experimental limits exists only for the 
sum of the charge states of particles and antiparticles states, we should consider for i =/= j 



B(Z — > lilj + klj) 



B(Z->ZZ) 



\9v\ 



\9A\ 



9y 



+ 



1 1 

9a 



(22a) 
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B(Z -» ZZ) 



It then follows that 



I5v I 



+ 



Af + sfe +o(e 2 ). 



A« + s«e < cB M -„ 



(22b) 



(23) 



1 = (< 



B(Z->iQ 



where c" i + , — — t 

V |9v| 2 + |3a| 2 

values for gy and <?a) and where 



0.536 (using the conventional SM branching ratio 0.0337 for B t j and the standard 



Be 

B, 



B, 



< 1.7 x 10" 6 

< 7.3 xlO" 6 

< 1.0 xlO" 5 



Be 
B fi 



= B„ 



(24) 



according to the experimental limits [9, 10]. This means that the fermion mixing parameters A l J are bounded 
to lie in a circular region centered at (— Sj^ O, — S^O ) and of radius ~ 10~ 3 . 

It's evident that the contribution of in the analysis of A l J is non negligible when 



E ij Q > 



\J cB kh- 



(25) 



This may be a common situation, since in general S^' = 0(1) and the upper bounds for 0, which are model 
dependent, are of the order of 10 _1 to 10~ 3 . Taking the limit 0^0 could lead to wrong conclusions: a 
contribution of S^0 ~5x 10~ 3 is enough to give a completely new region of solutions for A l J . The results of 
this section are resumed in table 1. 



3.2.2 Constraints from Zj — ► Ijljlj 



Assuming mj 4 » mi j and ignoring possible contributions from scalars, the branching ratio B(Zj — + Ijljlj) for 
i + 3 is 



B(Zi 



l 3 l 3 l J 



B(Zj -> ljVi v h ) 



+ 



9 3 l 



11 

9v 



+ 



1 1 

9a 



+ 



Ml 



1 Mi 



-'>' ('/V'/A >^ (<#fff ) 



+ 



2M|, 



'77 

5v 



'7 7 

5a 



5v 



/Z7 

9a 



25fte (^ fl f*)25Re (sW) 



(26a) 



~ 4 



(2|-|+sl| 2 + 



2 ) 



A? J +S^0 



+ 



+ 2s 



A^+^0 



O(0 2 ) 



(26b) 
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where we have assumed (j$^J ~ @> A^ ~ ® (remember that A l J is second order in the ordinary-exotic 
mixing) and we have taken into account the stringent limits obtained in eq. (21) from which 



Using the experimental bounds [11-13] 

I B 

and s^ w = 0.2237, the constraints on the mixing parameters are 



1 -i- « 2 



B^teee 


< 


1.0 x 10" 


12 


— B^ ccc 


Breee 


< 


3.3 x 10" 


-6 


= -Brccc 




< 


1.9 x 10" 


-6 





0.203 

where c; 4 = (4B(Z; — > IjV^v^)) 1 and 



0.176 



B, 



A£+S£0 



1.00 

0.1735 ±0.0014 



(27a) 
(27b) 



(28) 



(29) 



(30) 



As in sec. 3.2.1, the contribution of 6 in cq. (29) is important when 



0.203 



and 



-'Jo > 



0.176 



(31) 



The bounds for A£ e + S"0 and A^ + S^G obtained from eq. (29) are similar to those obtained from eq. (23). 
For the /ze case eq. (29) is more stringent than eq. (23). The results of this section are resumed in table 2. 



3.2.3 Constraints from L 



Assuming mi i » , mi k , ignoring possible contributions from scalars and neglecting the tree level diagrams 
which involve simultaneously two FCNC vertices, the branching ratio B(Zj — > Ijlkh) is 



B(Zj — > Ijlkh) 

B(li -» ljVlM U ) 



.,kk I 



(|5v| : !:/V 

M 2 



1 7 

5v 



■9a 



+ 



+ 



M 2 



z 23?e 



5a 5a J ^3y9v + 5a5a 



I /fefc i 

5A 



/i? 

5v 



+ 



5a 



- 4(|-i 



2 1^ 12 1^ 
3fl„. + So 



A^ + s^e 



(32a) 

a;^e;;o ]+o(e 2 ), (32b) 
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where we made the same assumptions as in section 3.2.2. Using the experimental limits [12] 



B 



Uijikik 



B(Zj — > Ijlkh) — 



Brcfifi < 3.6 x 10 — B ro ^ 



B T ^ eg < 3.4 X 1(T 6 



B 



the constraints on the mixing parameters are 



0.126 



Ar 



< c ;i B w . 



Wit 



(33) 



(34) 



which are not of interest in our analysis since they are somewhat weaker than those of eq. (29). 

4 Some SU(2)l representation for additional fermions 

Some improvement on the above derived bounds for the mixing parameters may be obtained with information 
about the SU(2)l transformation properties of the additional fermions and for this reason we analyze here 
a few simple SU(2)l representations in which new additional charged leptons may appear. In this analysis 
we will not consider any particular case for the S* J ' parameters, but we will assume that they are of 0(1). 
What follows is valid for one or more additional families, independently of whether the extra families are 
fundamental or excited leptons in the context of composite models. 



4.1 No additional fermions 

Equations (23) and (29) are valid even if no additional charged leptons are present in the extended theory. In 
this case F = Al = Ar = and 



— "R 



H a = (AtH A) o . 

There are three subcases: 

1. H is of the UFD type. Then Z docs not couple to FCNC since (A' t A) a = 1 and therefore 

for i ^ j, 

2. Ho is of the NUFD type. Then there are two possibilities: 

(a) A = 1 (no mixing among the ordinary leptons). Then Z does not couple to FCNC. 

(b) A ^ 1. Then Z couples to FCNC. 

3. H is of the FCNC type. Then Z couples to FCNC. 
Therefore when FCNC exists, eqs. (23) and (29) read: 



S£6 



< cB 




3.2 x 10~ 6 
1.4 x 10~ 5 
1.9 x 10" 5 



and 



0.203 



H"9 



0.176 



r < 



c T B reee 
c T B T 



0.25 x 10~ 12 
4.8 x 10~ 6 
2.7 x 10~ 6 



(35) 



(36) 



(37) 



(38) 



respectively. All the constraints are for the product S^ 6 of the couplings of the light fermions to the Z' and 
the Z-Z' mixing angle. In particular S° M 6 < 10~ 6 . 
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4.2 Sequential fermions 



^3EL 
^3ER. 



A L = A R = 0, 



(A+HoA + FtH E F) a . 



(39a) 



(39b) 



The situation is the same as that of no additional fermions. Eqs. (37) and (38) hold with the only difference 
that when F ^ then a a contains the (F^HeF) contribution. As in the previous case the strongest constraint 
is for 5^0 < 1(T 6 . 



4.3 Vector singlets 



^3EL — 
^3ER = 



A R = Al = \ (F^F) L , 



H a = (AtH A+FtH E F) a . 



Therefore eqs. (23) and (29) now read 



and 



0.203 



+ 



< cB, 



0.176 



< c h B hh 



(40a) 
(40b) 

(41) 

(42) 



respectively. The contribution to FCNC from the ordinary-exotic fermion mixing is only left handed. If 
~ 0(1), then the stringent bounds on O, consequence of S^O < 10~ 6 , imply an equally stringent bound 



on A e L ". 



4.4 Vector doublets (homodoublets) 



^3EL — —\ 
^3ER = —\ 



A L = A R = -i(F t F) R , 



H a = (AtH A+FtH E F) a . 



Thus eqs. (23) and (29) now read 



A^ + s^e 



and 



0.203 



+ 0.176 



Ag + s^e 



< cB a 



(43a) 
(43b) 

(44) 

(45) 



The contribution to FCNC from the ordinary-exotic fermions mixing is only right handed. The conclusions 
are the same as in the previous case with L <-» R. 
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4.5 Mirror fermions 



t 3 EL = | 
^3ER = —\ J 

H a = (AtH A + FtH E F) a . 
Hence cqs. (23) and (29) are unchanged 



A L = H FtF ) L A H = -|(F t F) R , 



and 



0.203 



< cB, 



0.176 



< <v '*//// 



(46a) 
(46b) 

(47) 

(48) 



The contribution to FCNC from the ordinary-exotic fermions mixing is both left and right handed. As a 
consequence there are no stringent bounds on and the limits on A l J and are strongly correlated. 



4.6 Self conjugated triplets 



^3EL — —1 "| 
*3ER = -1 J 

Hence eqs. (23) and (29) arc unchanged 



A L = -HF f F) L A R = -(FtF) R , 
(AtH A + FtH E F) o . 



A^ + sge 



< cB 



and 



0.203 



+ 0.176 



(49a) 
(49b) 

(50) 

(51) 



As in the previous case the contribution to FCNC from the ordinary-exotic fermions mixing is both left and 
right handed. As a consequence there are no stringent bounds on 9 and the limits on A l J and are strongly 
correlated. 



5 Conclusions 

In a model independent way we obtained bounds for the strength of the FCNC, (A + S0) o , in the ordinary 
charged-leptons sector, produced both by the ordinary-exotic fermion mixing, A Z J , and by the Z-Z' mixing, 
0. Giving that the experimental bounds on the decay \x — > eee are more stringent than those for the FC decays 
of the r into three charged leptons and of the Z into two charged leptons, the bounds on the /z-e coupling of 
the Z are stronger than those on the r-e and T-fi couplings. We have shown also that in some cases, when 
the SU(2)l representation of the additional fermions is relatively simple, the bounds may be refined. In other 
cases there may be a strong correlation between and A l J and then it is not safe to take the limit 0^0. 
In the same way, if one consider specific extended models, e.g. [1, 14-21], some additional statements may be 
drawn on the . In this work we have concentrated our attention to LFV in decay processes. On the other 
hand, there may be LFV processes of a different type [22] which will certainly put additional constraints on 
the LFV parameters. 
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